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Abstract —Edge detection is a very essential part of image 
processing, as quality and accuracy of detection determines the 
success of further processing. We have developed a new self 
learning technique for edge detection using dictionary comprised 
of eigenfilters constructed using features of the input image. 
The dictionary based method eliminates the need of pre or 
post processing of the image and accounts for noise, blurriness, 
class of image and variation of illumination during the detection 
process itself. Since, this method depends on the characteristics 
of the image, the new technique can detect edges more accurately 
and capture greater detail than existing algorithms such as 
Sobel, Prewitt Laplacian of Gaussian, Canny method etc which 
use generic filters and operators. We have demonstrated its 
application on various classes of images such as text, face, 
barcodes, traffic and cell images. An application of this technique 
to cell counting in a microscopic image is also presented. 

Index Terms —Edge detection, dictionary, self-learning, eigen¬ 
filters 

1. Introduction 

I MAGE processing techniques to enhance the quality of 
images or to extract information from an image have 
become ubiquitous, in imaging systems such as cameras, 
microscopes, etc. Edge detection is an essential component 
of image processing as edges play an important role in 
visual perception. Edges in images can be defined as the 
points where sharp changes of colour and/or intensity occur. 
Current edge detection techniques utilize differential operators 
or combination of filtering operations or results from various 
techniques are combined together. There are many standard 
types of edge detection techniques, like Sobel, Prewitt and 
Laplacian of Gaussian that detect any discontinuities in color 
or intensity from one pixel to another in an image. 

In general, there are two categories of edge detection tech¬ 
niques. Eirst, gradient methods in which maximum and min¬ 
imum in first derivative is considered and other is Laplacian 
method which searches for zero crossing of second derivative. 
In practice, edges get blurred and noisy and the level of 
contamination depends on illumination, focusing mechanism, 
and noise level in electrical components of imaging system. 
Second derivative methods are more sensitive to noise than 
first derivative. Thus, there are three fundamental steps that 
are performed during edge detection, image smoothing for 
noise removal, detection of edge points, and edge localization. 
In Sobel and Prewitt methods these steps are performed 
separately and the results depend on the accuracy of all the 
steps. However, in Laplacian of Gaussian smoothing step is 
incorporated and Canny method consists of all the steps. 
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All the above methods use generic operators and do not 
consider the image characteristics. In this paper, we demon¬ 
strate an edge detection method based on image characteristics 
using a dictionary based algorithm. This method is different 
from traditional methods as it incorporates features of a given 
image, rather than using a set of pre-defined functions. 

In section II, we review popular existing algorithms for edge 
detection to which the results are compared in later sections. 
In section III, we present our algorithm of dictionary based 
edge detection. In section IV, we have compared the results 
with the popular techniques for different classes of images. 
We have also presented the application of the new method in 
barcode reading, counting of red blood cells and the results are 
compared with existing algorithms. We conclude and discuss 
further applications in section V. 

II. Review of Edge Detection Techniques 

Some of the most common techniques for edge detection 
employ gradient operators i.e filtering the image with one or 
more masks. These methods do not have any provisions for 
image characteristics and noise content. Methods such as Sobel 
and Prewitt have gradient operator in orthogonal directions. 
Eor continuous function these are expressed as, 

Vf{x,y) = [G, Gyr=[y^ (1) 

In practice for digital image processing calculation of partial 
derivatives, convolution is performed using a small kernel or 
mask, as images are comprised of discrete pixels. Eor Sobel 
method following two 3x3 kernels are used, one detects 
vertical edges and other horizontal edges. 
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where, E is the image in which the edge has to detected. 
Prewitt edge detection uses a similar gradient method but with 
slightly different kernels. The magnitude and direction of the 
edge from Sobel anf Prewitt methods, can be obtained by, 

G = G‘^ 0 = arctaniGy^ Gx) ( 3 ) 

An advanced technique used method which accounts for 
noise content and edge characteristics is Laplacian of Gaus¬ 
sian (LoG), in which regions of rapid intensity changes are 
highlighted by the Laplacian of the image. In this method, the 
image is first smoothed, generally by using a Gaussian kernel 
to reduce the sensitivity to noise. The Laplacian of the image 
with pixel intensity I{x,y) is given by, 
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(4) 


A smoothing filter has to be applied before the second 
derivative to reduce the effect of noise, LoG can be represented 
by a hybrid filter which incorporates both low pass filter 
and second derivative, Gaussian centered at 0 and standard 
deviation of a m, 


LoG{x^ y) 



a;2 + y2 _xW 


(5) 


Canny edge detector is more complex algorithm which 
is superior to other edge detectors. The key objectives that 
underpins Canny method are, low, error rate, localized edge 
points, and single edge point response O. In essence. Canny 
edge detector finds the optimal solution of the formulations of 
the aforementioned objectives. A two dimensional Gaussian 
function is used to reduce the noise, followed by gradient 
operation to calculate the strength and direction of edge at 
every point. Let, f{x,y) be the input image and G{x,y) = 

_ -\-y^ 

exp 2 ct 2 denote the Gaussian function, the smoothed image 
is given by 


fs y) = f{x, y) 'k G{x, y) (6) 

where, ^ denotes convolution. Further using equations 
and strength and direction of edges are calculated. A 
gradient method generally produces wide edges, nonmaxima 
suppression is used to thin out the edges. 

Over the years, these techniques have been improved upon 
but they work better only in specific cases and still are generic 
and do not use the characteristics of the image. An improved 
Sobel method which uses soft-threshold wavelet de-noising 
combined with traditional Sobel technique but it works most 
efficiently on images with white Gaussian noise 0. Another 
improved edge detection method uses a two level edge fusion 
model. On first level, typical edge detectors are used, where 
every pixel an edge score is calculated for every pixel 01 . Then 
results are combined at the second level using the Hadamard 
product with two additional edge estimations, based on edge 
spatial characteristics. 

All the above techniques use gradient operator along with 
some smoothing filters and combination algorithms for edge 
detection. The major problem of these methods is that they 
are generic, so edge detected depends on noise, blurriness and 
illumination of the image. However, a method that and elim¬ 
inates the process of pre-processing the image and depends 
on the features of the image being analysed is more likely 
to capture details in the image accurately. A self-learning 
algorithm which to adapts the filters and operators to the 
input image, irrespective of the class of image can provide the 
solution. In this paper, we have demonstrated an edge detection 
method based on image characteristics, using a dictionary 
constructed from the image itself. This method is different 
from traditional methods as it incorporates features of a input 
image, rather than on a pre-defined operators. 


III. The Dictionary based Edge Detection 

In recent years there has been a growing interest to study 
sparse representation of images using an overcomplete dictio¬ 
nary D G that contains K sample columns of a basis, 

The linear combination of these bases can be used 
to decompose a signal ^ G or an image. The representation 
can be exact y = Dx or approximate, \\ y — Dx ||p< e 
depending of amount of noise, where ’p’ can be 1,2 or cx), 
but generally p = 2 is used. The accuracy of approximation 
depends upon the quality of dictionary. Methods such as basis 
pursuit and matching pursuit are used to construct dictionaries 
with reasonable approximation. Since, we are interested in the 
features of the input image and one of the best way to extract 
key features is principal component analysis. 
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Fig. 1: Input Image: (a) Illustration of image F indicating 
small segments, (not to scale), (b) Illustration of 3D dictionary 
formed using small segments (si) of the image. 


Consider a test image, F of size NxN pixels (fig[^ test 
image has N = 512) in which color discontinuities, intensity 
variation are the key features for edge detection. In order to 
make the process more specific to an image, the filters have 
to be formed by analyzing the features of the image itself. 
The entire image is divided into small sections or sub-images 
(si, S 2 , • • • Sn) of size n X n, (in this case n is 4, fig 6c) to 
form the dictionary. 

The choice of size of the segment cannot be arbitrary. The 
size of the segments is related to the kernels derived, which 
are used for detecting the edges. Optimal size of the segments 
is 3 X 3 to 5 X 5, if the size of segments is too small, kernels 
formed will not be sufficient to capture all the important image 
characteristics. If the size is too large like 8 x 8, we observe 
that the image extracted captures very less detail because key 
features of the image, is also interpreted as noise and hence 
is eliminated. 

The dictionary is composed of Si,S 2 ,''’Sn, which are 
evidently images. All the elements of the dictionary are 
averaged, given by and subtracted from each element, 
to reduce the noise and increase the sharpness, due to low 
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Fig. 2: Matrix formed by elements of dictionary. 


pass and high pass filtering nature of averaging and subtraction 
operations, respectively. 

1 "" 

= $i=Si-^s (7) 

n ^ 

2=1 

To find the key variations in each sub-image, principal 
components have to analyzed. But, the calculation of principal 
components for each sub-image involves solving of a large 
eigenvalue problem which may not be efficient to calculate. 
To get round this problem, we devised a method in which the 
n X n elements in the dictionary are transformed into column 
vectors of size x 1 and concatenated in matrix A (fig. 

of size V? X N‘^fn‘^. For the calculation in this paper, N 
= 512 and n = 4, hence the size of A is 16 x 16,384. The 
technique to construct the dictionary based on PCA, which is 
similar to the calculation of eigenfaces for recognition lO. The 
eigenvectors of covariance matrix AA^^ of size x (16 
X 16) are calculated. This reduces the number of eigenvalue 
problems for each sub-image to just eigenvalue problem for 
one matrix. 


AA^vt = A,-Ft 


( 8 ) 
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Fig. 3: (a) 3d array of images (ei) after convolution with 
r and thresholding. Intermediate edge images obtained after 
convolution with eigenfilter. (a) Edge image obtained by 
eigenfilter 14. (b) Edge image obtained by eigenfilter 15. 


The edge detection by individual eigenfilters is along one 
direction, as shown in fig. Edges detected by each of the 
eigenfilters for a binary object is shown in the appendix. 
To improve the quality of the edges, the edge images have 
to be combined. From edge image obtained, it is apparent 
that neighboring filters have similar characteristics. Thus, to 
enhance the edges, each pair of consecutive elements in the /3, 
maximum for each pixel in consecutive images is calculated, 
maximum of ei and ei_i, as each consecutive eigenfilter is of 
similar characteristics (such as derivative filters) but in almost 
perpendicular direction (see fig. |12c|and|12e[ in appendix). 


cxi = max{e{,e{-i) ( 11 ) 

where, cxi are stored in a 3D array (3'. The second last 
element of the new 3D array of 15 elements gives the 
desired edge because the last eigenfilter just reduces the 
intensity of the image (as shown in appendix) and is not 
useful for edge detection. The number of eigenfilter can vary 
depending on the size of sub-images taken and eigenvectors 
considered for convolution. 


= r * Ui (9) 

Here, are the eigenvalues and are the eigenvectors, * 
represents convolution of original image (F) with ui, which 
are the rearranged eigenvectors to give ei, intermediate edge 
image stored in a 3D array (fig. [^. These 'n? eigenvectors of 
size v? X 1 (16x 1) which are rearranged to form a dictionary 
of 16 kernels (ui) of size n x n, i.e 4 x 4 (fig.??). We have 
termed the derived kernels as eigenfilters. They have to be 
convoluted with image to detect edges along one direction, 
like a filter. The name eigenfilter originates from the work 
of Vaidyanathan and Nguyen |[9|. After convolution of each 
eigenfilters with F, filtered images are stored stored in a 3D 
array (fig[^. The average of this 3D array is subtracted 
from individual elements of the array to give another 3D array 
/3. 


IV. Results and Analysis 


In this section, we have shown the application of the 
dictionary method in edge detection on various classes of 
image and provide solution to the problems with traditional 
methods. First, we have applied standard Sobel and Laplacian 
of Gaussian edge detection techniques on a Chinese character, 
which comprises of straight lines and curves and compared 
the results with dictionary based method. 

The edge found by the dictionary based method is much 
more pronounced than the standard methods for simple im¬ 
ages. To get the same performance in terms of edge continuity 
from the traditional techniques, the edge image has to be fur¬ 
ther subjected to morphological image processing techniques, 
such as dilation. The difference in the edges detected can be 
observed from the following cases. 

For complex images such as the Lena image shown in fig. 
6a the output from dictionary based method is well defined, 
capture more features of the image and produces a continuous 
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Fig. 5: Edge detection in traffic image, (a) Original Image, (b) Grayscale image, (c) Edge detected by Sobel method, (d) 
Laplacian of Gaussian (e) Canny method (f) Dictionary based method. 


(a) (b) (c) (d) 

Fig. 4: Comparision with different methods of edge detection. 
The edges detected by dictionary based method are more 
detailed, (a) Original image of a Chinese character, (b) Edge 
detected by Sobel method, (c) Edge detected by LoG method, 
(d) Edge detected by dictionary based method. 




(a) (b) (c) 

Fig. 6: Comparision between Sobel and Dictionary method 
of edge detection, (a) Original image of Lena, (b) Edge by 
Prewitt method, (c) Dictionary based method. 


images such as text, face or cell images than the existing 
techniques, specially when the image is not captured at the 
highest resolution. 

In practical situations, image is contaminated with noise, 
varying illumination shadows, glare etc. and these affect 
the quality of edges detected. Here, we have demonstrated 
application of various edge detection techniques on an images 
of roads full of cars (see fig. |^. The image is first converted 
to grayscale image (fig. and the same image is used for all 
the methods without any pre-processing. Edges images from 
Sobel. Laplacian of Gaussian, Canny and Dictionary based 
method has been shown in fig.|^|^[^and[^ respectively. 
It is quite evident from the results that dictionary based method 
procudes the best results with pre-processing. It also takes care 
of the varying illumination, noise, glare from headlights of the 
car and shadow which are shown as edges in output from LoG 
and Canny as they are more sensitive than Sobel method. This 
shows the advantage of having an algorithm that adapts to the 
input image and uses its feature for edge detection rather than 
a generic operator. 

Accurate and fast edge detection techniques have many ap¬ 
plications in image processing. In the following sub-sections, 
we will demonstrate the application and advantages of dictio¬ 
nary based method in barcode reading and cell counting. 


edge image as compared to Prewitt method. Also, for images 
which are not completely focused, the new algorithm performs 
much better. The calculation of eigenfilter by dividing into 
small segments increases the probability of capturing small 
peaks. The subtraction of reduces the remaining noise, 
improves edges as well as suppresses the background. The 
new dictionary based gives better results for every class of 


A. Barcode Reading 

Barcodes have been used to store information for a long 
time. Primitive ID barcodes are now being replaced by 2D 
barcodes which can contain much more data. But for reading 
these codes special hardware is required. Also, techniques to 
read ID barcodes or stacked 2D barcodes such as, second 
derivative, peak location and EM algorithm require high 
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resolution of scanned image oni. In recent years, new smart¬ 
phone based reading barcode is gaining popularity. But still, 
for camera based interpretation of barcode is still limited, 
as binarizing the image to compute the bit pattern is not 
accurate in cases where image is blurred or distorted. To read 
the a 2D barcode segmentation of image, size detection and 
coordinates of four corners is required ifTOl . With accurate 
edge detection, the process of segmentation, size detection 
and corner locations can be enhanced. The edge image can 
also be used to calculate the rotation or tilt in the image more 
precisely. 

As shown in fig. we have a 2D barcode named Aztec 
Code. When edges are detected using Sobel and dictionary 
based methods the results are not very different for image with 
highest resolution. However, when the same image is blurred, 
as would happen in most practical cases, the advantage of self 
learning algorithm becomes evident. With the new algorithm 
which can detect edges from low resolution images, camera 
based interpretation of barcodes can be done more accurately 
using smart phones or web-cameras. 



Fig. 7: Edge detection in highest resolution image of Aztec 
Code, (a) High quality Aztec Code image, (b) Edge detected 
by Sobel method, (c) Dictionary based method. 



Fig. 8: Edge detection in blurred image of Aztec Code, blurred 
by averaging filter of size 12. (a) Blurred Aztec Code image, 
(b) Edge detected by Sobel method, (c) Dictionary based 
method. 


Another possible application can be in scanning of text 
images, where the edges are grainy or fonts are small to 
be captured clearly. Edge detection technique combined with 
average image capturing hardware can be used to produce high 
quality image. The output edge image from Prewitt method is 
not continuous as compared to output from dictionary method 
in the case where boundary of letters are not continuous and 
this could lead to errors in cases where small font size is used. 

B. Counting of Red Blood Cells 

In Biomedical imaging, edge detection algorithms can be 
used to count cells, detection of tumors etc. Counting of 


cells usually requires special apparatus which are expensive. 
For using techniques of snapshots of a sample to count and 
segment image, edge detection technique becomes extremely 
important. 
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Fig. 9: Application on red blood cells, (a) Original RBC 
sample, (b) Edge detected by Sobel method, (c) Edge from 
Dictionary based method, (d) Estimation of number of RBC. 


With the use of the method described in this paper, it is 
possible to identify edges more accurately and in much more 
detail. In this paper, we have used an image of RBC cells taken 
from microscope with objective of lOx magnification(fig|^. 

The final image has dark background which has to be 
removed to make the edges more clearer and display in 
familiar form. For removing the background, a threshold on the 
intensity values of the pixels is applied to remove background. 
It is fairly simple, threshold varies slightly for different images 
and can be estimated from the histogram of the image. After 
applying the threshold, advantage of proposed method over 
the existing techniques become evident. 

While for Sobel method the edge detected are fainter and 
discontinuous. The dictionary based method is able to detect 
very faint boundaries and also of cells which are in the process 
of division. Sobel method is unable to detect cells that are 
joined partially or completely and in some cases it has not 
picked up the cells at all. 

In fig. [T^ a magnified view of two sections of image and 
corresponding edges detected by Sobel and dictionary methods 
has been presented. In first, the cells are joined together to 
form a long string and in second, there is a cluster of cells of 
different sizes and present at varying spacing. These are two 
types of sections in which estimating the boundary of cells 
and subsequently estimating the number of cells can be most 
difficult. As seen from the figure, dictionary based method 
produces a better edge image than Sobel method. To estimate 
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the number of cells, we have taken the advantage of circular 
shape of the red blood cells and fitted the edge image with 
circles using circular Hough transform based algorithm which 
is also available in Matlab CH C3. This approach is used 
because of its performance in presence of noise and varying 
illumination. The radius of circles fitted has slight variation 
to account to cells in different stages. The range of radius 
of circle depends on the magnification of original image and 
typical cells size which is obtained from edge image. Another 
point to consider is that not all cells are circular and cells 
which are in the process of division look like two joined or 
half circles. Inter cellular space can also have similar circular 
features that can be picked in number estimation. From fig. 


101, it can be seen that fitting depends on the quality of edges 


and hence the accuracy of count. 



Fig. 10: (a) Magnified view of RBC sample; (b) Edge detected 
by Sobel method; (c) Edge detected by Dictionary based 
method; (d) Estimation of number of cell by approximating 
cells to a circle. Hence, better detection of edges can lead to 
better approximation and more accuracy of counting. 

Thus, a few precautions that should be taken in fitting circles 
to count number of cells. In this paper, we have used range 
of radius from 3 to 8 pixels for both methods. Erom fig. [T^ 
estimation by Sobel method is not accurate as it misses many 
cells, counts inter cellular spaces and size of the estimated 
circle is not close to the cell size. Excluding the cells that 
are not completely contained within the image, total number 
of cells are 226, and the cells number of cells detected by 
dictionary based method is 225, with an error of 0.44%. 

Eor applications such as counting of cells, the dictionary 
based method has advantage over other methods as it detects 
more accurate and continuous edges and allows fitting circles 
which not only counts the RBCs, but also estimates the average 
and variation of radii of the cells. 


At the beginning of the paper, we have highlighted major 
issues that exists with the traditional methods. In general, they 
reqires pre-processing of the image and it depends on the type 
of noise, class of image etc. A method that takes the inputs 
image and used its features for calculation edges eliminates 
this step. Eurthermore, dictionary based method demonstrated 
in this paper is not affected by noise, blurriness, class of image 
or varying illumination, shown through various examples and 
provides a smooth solution to the problem of edge detection. 

We have demonstrated its application in variety of areas 
and compared the results to that of existing algorithms. It can 
detect accurate edges from blurry image, enabling accurate im¬ 
age segmentation thus making barcode reading using cameras 
more reliable. It also improves the quality of text in cases 
where letters are grainy with small fonts. Dictionary based 
method can also be used to count the number of red blood 
cells in a sample without the need for specialized equipments. 
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V. Conclusion 

In this paper, we have proposed a new edge detection 
algorithm using dictionary comprised of the key features of the 
image. Since the eigenfilters are derived from the input image, 
it becomes image specific and sensitive to its features. This 
enables the algorithm to adapt to different classes of images 
and produce better results. Its shown in the paper, results from 
the new method is much more accurate and detailed than 
existing algorithms. 
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Fig. 12: Eigenfilter displayed as an image with respective edge 
images (before combining for final edge image). 





































